Crawler Management: A spider pool provides webmasters with tools to manage various aspects of search engine spider behavior. This includes setting crawl frequency, defining which parts of the website are accessible to spiders, and specifying the maximum number of concurrent crawling sessions.
Copyright 1995 - . All rights reserved. The content (including but not limited to text, photo, multimedia information, etc) published in this site belongs to China Daily Information Co (CDIC). Without written authorization from CDIC, such content shall not be republished or used in any form. Note: Browsers with 1024*768 or higher resolution are suggested for this site.